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ABSTRACT 

Two computer assisted instruction programs tested the 
effects of plain and enhanced screen designs with or without 
information about those designs and task-type on time and learning. 
Subjects were 140 fourth grade students in Lincoln, Nebraska who had 
extensive prior experience with computers. The enhanced versions used 
headings, directive cues, running heads, and graphic devices to 
organize and structure the content. One program required learners to 
perform a memorization task, while the second involved concept 
acquisition and concept application. The information provided with 
one version of the memorization lesson described the purpose of the 
enhanced features and instructed the students to use those features 
while studying. Although the plain screen versions were found to be 
equal to the enhanced versions in learning, descriptions of text 
enhancements reduced lesson time when one of the enhancements 
provided the learner with program control options. The text is 
supplemented by 5 figures, 7 tables, and 25 references. (EW) 
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Abstract 

Two CAI programs tested the effect of plain and enhanced screen designs with 
or without information about those designs and task-t>'pe on time and 
learning. The enhanced versions used headings, directive cues, running 
heads, and graphic devices to organize and structure the content. One 
program required learners to perform a memorization task, the second 
required concept acquisition and concept application. The information 
described the purposes of the enhanced features and instructed the students 
to use those features while studying. The plain-screen versions were equal 
to the enhanced versions in learning. Descriptions of text enhancements 
reduced lesson time when one cf the enhancements provided the learner with 
program control options. 



Introduction 



Problem Description 

The display of instruction&l text is 
not solely a function of the author's 
writing, but also of the publisher's 
layout design and selected medium, 
whether that medium is paper or 
electronic text. In both types of me- 
dia, text format elements (see Table 
1) are com;lbined to create "pages" 
and "screens" of information. In the 
case of print media, pages are usu- 
ally arbitrary points for dividing 
text, whereas in electronic text, 
screens serve as logical imits of in- 
formation. The representation of an 
author's instructional message in 
the selected medium, though, is not 
where the problem of design ends, 
for instructional text, has an addi- 



tional function. Instructional text 
must encourage an interaction be- 
tween learner and text; it must fa- 
cilitate the cognitive processes of 
reading and leeaming. The primary 
design problem, then, is to identify 
those combinations of text elements 
which facilitate specific learning 
processes. 

Manipulations of text elements fall 
into two general categories: efforts 
to imitate the effective stimulus and 
efforts to facilitate the reading and 
learning cycles with mathemagenic 
devices or activities (for reviews of 
this research see Grabinger, 1984; 
Hartley, 1982, 1985, 1987). Phrase 
chunking, which focused on making 
the printed page, or nominal stimu- 
lus, mirror the readers' perceived 
image of the printed page, or effec- 
tive stimulus, usually had little ef- 
fect on reading speed or comprehen- 
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slon (Carver, 1978; Pynte and Noizet, 
1980). This lack of effect may be due 
to the undefined and dynamic na- 
ture of the effective stimulus, for it 
is difficult to imitate something that 
cannot be seen, something that is in 
. a constant state of change, and 
something that varies from individ- 
ual to individual. On the other 
hand, efforts aimed at facilitating 
the interactive processes of reading 
and learning through the use of 
headings, questions, hierarchical 
paragraph indentation, and directive 
cues sometimes improved compre- 
hension when those activities were 
directly related to specific objectives 
and when the reader was aware of 
their purposes (Bausell and Jenkins, 
1977; Prase and Schwartz, 1979; 
Hartley, Bartlett, and Branthwaite, 
1980; Hartley and Trueman, 1982.) 

The main conclusions drawn from 
these findings suggest that successful 
design strategies are those that re- 
inforce and facilitate the reading and 
perceptual cycles. Though general- 
izations can be reached about the 
effective uses of some specific ele- 
ments in defined circumstances, it is 
difficult to draw conclusions about 
combinations of the vast majority of 
less intrusive text elements— ele- 
ments that do not overtly direct spe- 
cific cognitive processes. 

Discovering the effect of combina- 
tions of elements is made difficult by 
the large number of text elements in 
operation at one time. To simplify 
the research problem, a way to cat- 
egorize those variables was devel- 
oped (Grabinger, 1984, 1987; Gra* 
binger and.Arrtedeo, 1987). This clas- 
sification scheme is based on view- 
ers* judgments about screens. 
Viewers who evaluated model 
screens composed of a variety of text 
elements preferred designs that ap- 
pear organized, structured, and/or 
simple. Organization refers to de- 
signs that have clear-cut segments 
of text using indentation or graphic 
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organizers such as boxes, windows, 
or areas of shading or color. 
Structure is a more refined level of 
organized text, referring to text de- 
signs that indicate a hierarchical 
and systematic arrangement of 
subject material utilizing running 
heads, headings, increased space 
between paragraphs and, directive 
cues. Simplicity refers to short, 
concise, and spacious looking 
screens. 

In other words, it was discovered 
that the design of the page or screen 
suggests something about the content 
of the text on the page. Individual 
text elements contribute to a 
''whole*' screen or page image and, 
while individual elements are per- 
ceived, it is the overall combination 
that affects the vie^^'er. The 
viewer, as a result cf that overall 
combination, makes judgments about 
the content of the text. The question 
raised, then, is whether the graphic 
arrangement of the information does 
more than suggest something about 
the content of the text such as, does 
the arrangement effect how the 
learner approaches the text, and in 
turn, learning from the text? An 
answer to that question may lead to 
the development of guidelines for de- 
signers of electronic text generally 
and of CAI specifically, guidelines 
that may point relationships be- 
tween text design features and the 
activation of cognitive processes and 
learning strategies. 

In an effort to answer that question, 
the aforementioned constructs of 
structure, organization, and sim- 
plicity were used to guide the design 
of screens in several versions of two 
CAI programs. Two types of screens 
were used: plain and enhanced. 
Plain screens suggested little about 
the content of the text while the en- 
hanced screens presented structured 
and organized displays. 
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In addition to the- ecreen layout two 
other variables were included in the 
text design. First, to vary the types 
of outcomes expected from the learn- 
ers, two types of tasks, memoriza- 
tion and concept learning, were in- 
cluded in the program designs. It is 
also recommended that readers be 
informed of special textual design 
devices and how to use them (Pace, 
1985), 80 descriptions about the 
screen designs were included in 
some of the program versions. 

It was predicted that students who 
used the enhanced screen versions 
would invest more mental effort in 
studying the material. Therefore, 
students using the enhanced version 
would spend more time with the 
program and, as a result, score 
higher oh both immediate and de- 
layed retention tests than students 
using the plain versions. 



Method 

Subjects 

Subjects were 140 fourth grade stu- 
dents from three public schools in 
Lincoln, Nebraska. The students 
were predominantly white, lower 
and middle class with 71 females 
and 69 males. All students were 
reading at least on the fourth grade 
level and had had extensive prior 
experience with computers in the 
forms of CAI, Logo, and keybozu'd op- 
eration lessons. Participation was 
voluntary and dependent upon 
parental permission. 



Program Content 

Two programs. Order and Orbit, 
were produced in several versions 
utiUzing the Saber (1985) authoring 
system, an MS-DOS based program. 
Within each program, the content, 
questions, and learning activities 



were identical. The versions dif- 
fered in the design of the screens 
(see Figure 1) and whether any pre- 
liminary information and instruc- 
tions were provided. 

Order required a memorization 
task and taught the spelling of and 
the order of the planets from the 
sun. The lesson material was di- 
vided into five parts: 1) a brief in- 
troduction describing the purpose of 
the lesson and, in one of the en- 
hanced versions, a description of the 
purposes of the text elements on the 
screen; 2) a pretest to test the 
ability of the students to spell the 
planet names correctly, 3) a brief 
section to drill students in the cor- 
rect spellings of the planets, if 
spelling deficiencies were found; 4) 
a section for learning a mnemonic to 
help memorize the order of the plan- 
ets from the sun; and 5) a test on 
the students' ability to list the plan- 
ets in the proper order. 

Orbit taught the concepts of ellipse 
and planetary orbit and had four 
versions. The lesson material was 
divided into four parts: 1) a brief 
introduction describing the purpose 
of the lesson and, in the enhanced 
versions, the purpose of some of the 
text elements on the screen; 2} the 
concept of ellipse was explained us- 
ing examples, nonexamples, and at- 
tribute isolation with text, graphics 
and, animation; 3) students were 
tested on their ability to identify el- 
lipses from among other shapes; 4) 
the concept of ellipse was then used 
to describe the orbits of the planets 
and to explain how Neptune, at 
times, becomes the furthest planet 
from the sun; and 5) a test of 
their ability to apply the concepts to 
the Neptune/Pluto phenomenon com- 
pleted the program. 

The Design of the Screens 
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Overall Standard?!. All screens (see 
Figure 1 for models) were designed to 
meet "recommended legibility" stan- 
dards. (Recommended standards are 
not hard and fast rules, but flexible 
and derived from research in both 
printed text and electronic text. The 
most recent and concise summary is 
in Hartley, 1987.) Lines of text were 
double spaced, unjustifiea, and kept 
to a maximum width of 40 charac- 
ters. Indentation was used to reflect 
subordinating ideas. Responses were 
always made toward the bottom of 
the screen. One idea was used per 
screen. 

Plain Vcralons. The plain versions 
included text, white on black, with- 
out headings, directive cues, graphic 
organizers, or running heads. 

Enhanced Vgr«i<nwn^ Enhanced 
screens were designed to appear 
structured and organized, yet spa- 
cious and simple. Each screen in the 
enhanced versions included at least 
one heading describing the content of 
the page, a running head at the top 
of the page to describe the general 
content and task required in the 
section of the program the student 
was in, and at least one directive 
cue in the form of color highlighting 
to emphasize an important word or 
phrase. Where pertinent, a graphic 
organizer in the form of a box (see 
?igure 1) or background color change 
was used to help organize subtopics. 
A second running head was added to 
the bottom of the screen in the Or- 
bit versions to summarize the 
keystroke commands to move back 
and forth among the screens (this 
second feature is not seen in exam- 
ples in Figure 1). 
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The Information. In Order 3 the 
information described the trrt ele- 
ments of running head, heading, di- 
rective cues, and graphic organizers 
and explained why they were used. 
The instructions in the Orbit 2 and 



Orbit 4 described the text elements 
and informed the students how to 
use special keys to move back and 
forth between the screens to review 
material. 

Lesson Vtrsions 

Order had three versions (see Fig- 
ure 2). Order 1, was a plain. Or- 
der 2 and Order 3 were enhanced 
with the additions of a running 
head, color, boxes, and lines to make 
the screens appear more organized 
and structured. Finally, instruc- 
tions on the meaning of the various 
text elements and how to use them 
to study were includlMi with the 
third version. Order 3. 

Orbit had four versions. Orbit 1 
was plain. Orbit 2 was also plain,' 
but included instructions on how to 
use specific command Ir^s to re- 
view previous screens. The screens 
in Orbit 3 were enhanced with the 
additional text elements. Orbit 4 
included the enhanced screens and 
added the information about the 
features of the screen and how to 
return to previous screens for re- 
view. 

Orbit had four versions because it 
included the addition of command 
key descriptions. Order had only 
three versions because a sophisti- 
cated branching design controlled 
student moves to reviews and prac- 
tice. 

Measurements 



three measurements were used as 
dependent variables: average time- 
per-screen, immediate recall tests, 
and delayed retention tests. The 
total time spent on ths program «vas 
divided by the total number of 
screens seen by the student for the 
time-per-screen (TimPerScr) vari- 
able. TimPerScr was used as an in- 
dication of whether the added text 
elements encouraged the student to 
Zoo 
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spend more time studying, organiz- 
ing, reflecting, or memorizing the 
subject material. The tests for the 
Order program were composed of 9 
questions requiring the subjects to 
recall and list the nine planets in 
order from the sun. The Orbit 
tests were composed of five multiple 
choice questions asking the subjects 
to select ellipses from nonexamples 
and to test their understanding of 
the Neptune/Pluto phenomenon. 



Procedures 

Permission to use the public school 
students limited the time available 
to an average of 20 minutes per stu- 
dent. The programs were assigned 
to students in an ordered manner to 
insure a balance of subjects for each 
version. Students were assigned to 
the treatment by the cooperating 
teachers on a random basis. Stu- 
dents entered the treatment rcom 
and sat before an IBM PC with a 
color monitor. The program was 
then started. The experimenter 
pointed out the "ENTER" key, ex- 
plained its purpose, and monitored 
the progress of the student. The 
only assistance offered by the ex- 
perimenter was to help the student 
recall the proper key sequence to 
proceed in the desired manner. No 
assistance was provided with an- 
swering questions asked within the 
programs. Following completion of 
the program the students were 
given a certificate of achievement 
for participating in the experiment. 
The delayed retention test (RetTest) 
was given two weeks later. 

Results 



Design and Analysis 

Since the learning tasks in each pro 
gram were different, each was an- 
alyzed separately. The analysis be- 
gan with a MANOVA (SPSSx, 1985) to 



examine the effects of the indepen- 
dent variables of program version, 
school, and gender with all three de- 
pendent variables: TimPerScr, 
ImTest, and RetTest (see Figure 2). 
This was followed by a repeated 
measures ANOVA (BMDP, 1985) of 
each program version with the de- 
pendent variables of ImTest and 
RetTest. Finally, when necessary, 
separate one-way ANOVAs were 
performed to help interpret the re- 
peated measures ANOVA. A prede- 
termined significance level of p < .05 
was used. 

Order 

Seventy-eight students from three 
schools. A, L, and M, used the three 
Order versions. The MANOVA indi- 
cated a main effect among schools - 
(Table 2). The follow-up univariate 
F-test indicated that School L spent 
significantly more time-per-screen 
than either schools M or A (Table 3 
and Figure 3). The MANOVA re- 
ported no differences between gender 
or among the program versions. 
The repeated measures analysis 
shewed no difference for main ef- 
fects between the ImTest and 
RetTest variables and the program 
versions, but did indicate an inter- 
action (see Table 4). A one-way 
ANOVA follow-up (see Table 5 and 
Figure A) indicated that students 
who used Order S (enhanced 
screens with instructions) scored 
significantly higher on the delayed 
retention test (RetTest) than on the 
immediate computer test (ImTest). 

Reliability analyses of the 9-item 
ImTest and RetTest reported Cron- 
bach Alphas of .83 and .89, respec- 
tively. 

Orbit 

Sixty-two students from two 
schools, M and A, used the Orbit 
versions. The MANOVA results re- 
ported no main effect between the 
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schools, however there was a sig- 
nificant difference among the pro- 
gram versions (see Table 6) in the 
TimPerScr variable. The univariate 
F-test follow-up indicated that stu- 
dents using Orbit S (enhanced 
screens) spent more time-per-screen 
than students using the other three 
versions (see Table 7 and Figure 5). 
There were no differences between 
gender or among the program ver- 
sions within the learning variables 
(ImTest and RetTest). 

Reliability analyses of the 5-item 
ImTest and RetTest reported Cron- 
bach Alphas of .28 and .53, respec- 
tively. 



Discussion 



Orbit 4, on the other hand, needed 
no time to experiment because the 
purpose of each command was ex- 
plained at the beginning of the pro- 
gram. This would be consistent 
with Hartley's (1987) recommenda- 
tions that special design features 
should be explained to readers in 
advance. 

In the second case, students using 
the Order program in school L spent 
more time-per-screen than students 
in schools A and M. No differences 
among the schools were expected 
since all c5 the students were read- 
ing on at least the fourth grade 
level. Although no ability-level data 
was gathered, subsequent conversa- 
tions with teachers indicated that 
there may have been ability differ- 
ences among the schools. 



Though it was predicted that stu- 
dents would spend more time with 
the programs with enhanced 
screens, this difference occurred 
only in two situations. In one case, 
students using Orbit S spent signifi- 
cantly more time-per-screen than 
students using the other Orbit ver- 
sions. (Orbit 3 included a second 
running head with key command 
summaries, but did hot include in- 
formation about the text elements.) 
If the additional time-per-screen 
was due to the text element design It 
would be reasonable to expect users 
of Orbit 4 (identical to Orbit S 
with the addition of the text element 
descriptions) to have spent a similar 
amount of time-per-screen; how- 
ever, the users of Orbit 4 spent the 
same amount of time as the users of 
the other Orbit versions. It is more 
likely, then, that the difference is 
explained by the lack of instructions 
and text element descriptions in Or- 
bit S. The students using Orbit S 
were observed to have experimented 
with the commands at the bottom of 
the screen to discover the purposes 
of the commands. Students using 
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It was also predicted, on the basis of 
viewer preferences and classifica- 
tions, that structured screen designs 
would provide powerful cues to fa- 
cilitate mental involvement and thus 
incrj?ase learning from the CAI ma- 
terial. However, the lack of in- 
structional effects attributable solely 
to the arrangement of text elements 
indicates that graphi.; changes alone 
are not enough to increase mental 
involvement with the text. There 
are several explanations which may 
clarify why a learning effect was 
not found. 

First, Interventions that directly in- 
volve the learner have been more 
successful in affecting learning. In a 
study comparing a mathemagenic 
activity with a text element change, 
questions were found superior to 
highlights in aiding the learning of 
factual items and in aiding perfor- 
mance on higher cognitive operations 
(Schloss, Sindelar, and Cartwright, 
1986). Additional successful inter- 
ventions (Davey and Kapinus, 1985; 
Glynn, Britton, and Muth, 1985; 
Reder, Charney, and Morgan, 1986; 
Rieber and Hannafin, 1987; Smith 

0 
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and Friend, 1986) have involved elab- 
orative, orienting, or generative ac- 
tivities within the structure of the 
text, though it is not known 
whether any special changes were 
implemented on the design of the in- 
structional materials. These 
changes are also more mathemagenic 
than design changes to the page. 

A second explanation for the lack of 
learning effect may lie within the 
individual differences of the stu- 
dents. It was not possible, under 
the restrictions governing the par- 
ticipation of the schools, to gather 
more individual data about the stu- 
dents so, the effects of ability was 
not examined. In addition, all sub- 
jects were between 10 and U years 
old. This may be too young for stu- 
dents to recognize specific text ele- 
ments and then develop strategies to 
use those elements, for the develop- 
ment of effective learning strategies 
is in part related to maturation and 
experience. 

A third reason may be found in the 
instructional design of the software. 
The instructional design of both pro- 
grams proved effective, for there 
were no differences in ImTest or 
RetTest scores among the versions of 
each program. Ordtr included a 
mnemonic in its design, which is a 
powerful leaming strategy (Carlson, 
Kincaid, and Hodgson, 1976). Orbit 
was a highly visual program with 
some animation, which probably 
played to a learning strength of 
young people (Pavlo, 1979). 

Finally, the screens for all versions, 
even the plain versions, were de- 
signed to be consistent with publica- 
tion standards. There was no 
"ringer" version, a version designed 
so poorly that students would have 
had difficulty reading it. One of the 
possible generalizations, then. Is that 
a simple, leeible, clean design is as 
effective as the more complex and 
structured designs. 



There was one result difficult to ex- 
plain. There appears to be no ap- 
parent reason why Ordtr 3 would 
score significantly higher on the 
RetTest than the ImTest. Since this 
occurred vrith only one of seven 
groups, the difference may be the 
result of a small cell (24) or un- 
known intervening variables. 

Despite the lack of instructional dif- 
ference, there are implications for 
both screen design and future re- 
search. First, it appears that, for 
this age group, simple, spacious 
screens are as effective as more or- 
ganized and structured designs. It 
does not appear that fourth graders 
infer anything about the content 
from the arrangement of the text el- 
ements on the screen, though the - 
effects of enhanced designs on older 
age groups still needs to be exam- 
ined. Second, the addition of unex- 
plained text elements to the screan 
may prove distracting. Although the 
addition of a command key sum- 
mary v/lthout a description of its 
purpose did not interfere with 
learning in this case, its have a neg- 
ative affect on efficiency. The effect 
on undescribed text elements may 
vary with more complex material 
and different age groups. 
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T«bl« 1 

Examples of Text Format Elements 



line length 
type style 
hf'idins location 
type of directive cue 
ink color 

paragraph indication 
running head location 
justification 
character attributes:* 

reverse video 

underlining 

italics 

line breaks 

page numbering 

(*Isaacs, 1987; **Heii\es, 1984) 



type size 
leading 

use of dir4(ctive cues 

number of colunins 

paper color 

use of graphic devices 

use of headings 

word spacing 

functional areas:** 
running heads 
directions 
student responses 
error messages 
feedback to students 



2ii 
12 



Tablt 2 

MANOVA Results of Differences Among Schools for Order 



page 



Test Value Appt ox. P Hvpoth. I^F Error DP gilt.: 

PiUais .29611 3.18611 7340.19690 110.0 .006 



Tabic 3 

Univariate F-test: Differences Among Schools for Order 



Variable 


SS 


Error SS 


HvDoth. MS 


Error MS 


F Si«. 




TimPerScr 


.06757 


.36264 


.03378 


.00648 


5.21704 


.008 


ImTest 


37.72113 


373.81905 


18.86056 


6.67534 


2.82541 


.068 


RetTest 


36.28461 


451.70079 


18.14231 


8.06609 


2.24921 


.115 



Table 4 

Repeated Measures ANOVA for Order Program 



Source 


Sum of 
Sauares 


Degrees of 
Freedom 


Mean 
Sauare 


F 


Tall 
Prob. 


Mean 


7340.19690 


1 


7340.19690 


750.18 


.0000 


Order 


2.86386 


2 


1.43193 


.15 


.8641 


Error 


694.70370 


71 


9.7845G 






Main Effect 


3.82017 


1 


3.82017 


.83 


.3654 


2-Way Inter. 


32.42773 


2 


16.21387 


3.52 


.0348 « 


Error 


326.86957 


71 


4.60380 







Table 5 

FoUow-up ANOVA of Interaction Identified in Order Program 



Source 



Sum of 
Squares 



Degrees of 
Freedom 



Mean 
Square 



Tall 
Prob. 



Mean 
Error 



2523.00000 
193.00000 



1 

23 



2523.00000 
8.39130 



300.67 
.15 



.0000 
.8641 



Main Effect 
Error 



21.33333 
82.66667 



1 

23 



21.33333 
3.59420 



5.94 



.0230 



Table 6 

MANOVA Results of Differences Among Orbit Versions 



Test 


Value 


Approx. F 


HvDOth. DF 


Error DF 


SIR. 


Pillals 


.57965 


3.51250 


9.00 


132.00 


.001 



Table 7 

Univariate F-Test: Differences Among Orbit Versions 



Variable Hvpoth. SS Error SS Hvpoth. MS Error MS F Slg. 

TlmPerScr .29900 .36767 .09967 .00836 11.92746 .000 

ImTest 3.91677 92.38214 1.30559 2.09959 .62183 .605 

RetTest 4.27161 29.64762 1.42387 .67381 2.11316 .112 
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Figure 1 

Examples of Screens from the CAI Programs 

la. "Plain Vanilla" Screen 
f- ■ 



XXXXXXXWOOOOOOOOOOCXXXXXXXXXXMOOOOCX: 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 
xxxxxxxxxxxxxxxwoooooooocxxxxxxxx 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXM 
XXXXXXXXXXXXXXXXXXX} 

Mooooooooooocxiaaofxiaaooaocxxxx}! 

XMOOOOOCXXXXXlOOOOOOtXIOaOOCMOCXXXXX 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXK 

xxxxxxxxxxxxxxxxiooaooao 



V f 

lb. Enhanced Screen 















0000000000000000 

xxxiooflBH^Hocxxitxxxxxxxxxxxxxxioooooc 

xscxiaoaoaacKMooaaocicx)^^ 

xxsacxxxxxiooocxMxxxxxxxxsacx^^ 

xxxxsooocxxmcxxioooa 










0000000000000000 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx^ 

MOOOaOdOOCXKXXXIOOCXXKXXX^^ 
XXMOCXXXXXXXXXXXXXXXXXl 
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Fisurtt 2 

Diagram of Research Analysis 



P«8» f$ 



Order t Order 2 Order 3 



Imtest 
Rettest 



Timeperscr 



Ortlt 1 Ortn 2 Ortlt 3 Orbit 4 



imtest 



Rettest 



Timeperscr 



Figure 3 

Observed Means Among Schools For TimPcrScr 



3+ 
0 




Schools 
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Figure 4 

Interaction Program Version and Time of Test for Order 



1 

I., 




imtest 



Qrdtr 1 Ordtr 2 

Program Version 



Ordtr Z 



Figure 5 

Observed Means for Orbit Versions 



5t 




2 3 
Orbit Vtrslons 
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